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(54) Method for transfering image information 

(57) The invention relates to a method for transfer- 
ring image information from a camera module (1) to an 
electronic device, such as a mobile station (23). In the 
camera module (1), an image is formed by an image 
sensor (2) comprising pixels, where the light to which 
the pixel (P1 ,1 — Pm.n) is exposed is converted into an 
analog signal which is converted into digital image in- 
formation. The image information is transferred in serial 
form, and the transfer of the image information is con- 
trolled by the electronic device (23). 



R v P2 ' 



Pixel 
matrix 



MUX 



MUX 



S&H 



ADC 



Pre-processing 
block 



18" 



MEM 



Paraller/serial |<- 
converter 



OE1 



SSEL I^RSEL 



33-^i- 



11 



Control block 



Timings 



Sampling 
register 



A/D conversion 
register 



13 



Pre-processing 
register 



14 



15 



— Paraller/serial 
conversion register 



.10 



Fig. 1a 



Printed by Jouve. 75001 PARIS (FR) 



1 



EP 0 932 304 A2 



2 



Description 

[0001] The present invention relates to a method for 
transferring image information, a camera module, and 
a mobile station. 

[0002] In digital cameras and video cameras, an op- 
tical image is converted into electrical form by an image 
sensor, typically a charge coupled device (CCD). Such 
an image sensor consists of several photosensitive pic- 
ture elements (pixels) which are arranged advanta- 
geously in a matrix form. The number of pixels in the 
image sensor affects the resolution of the image to be 
formed. Typically, the image sensor used in cameras 
and video cameras consists of hundreds of thousands 
of pixels, for example 640 x 480 = 307 200 pixels. In a 
CCD sensor, light induces a charge in the pixel, which 
is affected e.g. by the intensity of the light as well as the 
time of action of light in the pixel, i.e. exposure time. 
Cameras are equipped with optics whereby the image 
is focused at the pixels of the image sensor. When a 
CCD sensor is used, the pixels are uncharged before 
taking the picture, whereby after a predetermined expo- 
sure time, each pixel has a charge which is proportional 
to the quantity of light directed to it and which can be 
measured. After the exposure, the entry of light in the 
CCD sensor is prevented e.g. with a mechanical shutter. 
The shutter function can be implemented also electri- 
cally by sufficiently quick reading of the image sensor. 
[0003] In the CCD sensor the pixels are chained by 
coupling them in series, and the output of the CCD sen- 
sor is coupled with the first pixel in the connection in 
series, whereby the image signal from the CCD sensor 
can be read by transferring charges from one pixel to 
the next, timed by a charge transfer signal. The charges 
can be read from the output of the CCD element, where- 
by the charge of the pixel coupled to the output is read 
first. In the same connection, the charge transfer signal 
induces the transfer of charges in other pixels to the next 
pixel, i.e. the pixel coupled to the output will receive the 
charge of the second pixel coupled to the same, the sec- 
ond pixel will receive the charge of the pixel that is third 
in the connection in series, respectively, etc. Each line 
of the image sensor can form a separate pixel chain. 
Each pixel chain is provided with a separate output from 
the first pixel in the chain, as presented above. From 
these outputs from the pixel chains, the charges can be 
transferred e.g. to a transfer register. Reading a CCD 
image sensor formed in this way requires transfers of 
charges in a way corresponding to the number of pixels 
in the pixel chain. Thus, measuring the charge of a sin- 
gle pixel is not possible except by carrying out the trans- 
fer of charges as presented above as long as the charge 
of the desired pixel is in the output of the image sensor. 
Using such an image sensor, undersampling of the im- 
age is difficult and slow because, in practice, the charg- 
es of all pixels in the pixel chain must be transferred to 
the output even though some of the pixels were not proc- 
essed in undersampling. 



[0004] The conversion of an analog signal generated 
by the image sensor to digital form can be conducted 
with an analog/digital converter. The conversion accu- 
racy of the analog/digital conversion is typically 8 bits, 

5 whereby 256 luminous intensity levels are obtained from 
each pixel. Considering the capacity of human eye, this 
number is usually sufficient to provide the required im- 
age quality. From the analog/digital converter, this con- 
version result is transferred in parallel form for further 

10 processing steps, such as for storing in an image mem- 
ory or on a video tape. In digital cameras and video cam- 
eras of prior art, the display device used is an analog 
display device, such as a LCD display device equipped 
with an analog connection, whereby the image is trans- 

15 ferred as an analog signal to the display device. 

[0005] In addition to the above-mentioned CCD sen- 
sors, recent development has involved so-called CMOS 
image sensors, whereby it is also possible to conduct 
the photoelectric conversion of the image. These CMOS 

20 image sensors are based on primarily two different op- 
erating principles: integrating and non-integrating image 
sensors. 

[0006] In integrating image sensors, the current gen- 
erated by the pixel is used to charge a capacitor ar- 

25 ranged in connection with the pixel. The charge of the 
capacitor depends on the strength and charge time of 
the current induced by the pixel. Before image forma- 
tion, each capacitor is uncharged, after which the cur- 
rent generated by the pixel starts to charge the capaci- 

30 tor, whereby the charge accumulated in the capacitor 
after the exposure is proportional to the quantity of light 
to which the pixel was exposed. Setting the exposure 
time of integrating CMOS image sensors can be han- 
dled e.g. by a mechanical shutter, whereby the control 

35 electronics can be made simpler whereby the exposure 
time of each image element is substantially the same, 
or by timing the discharging of the capacitor and meas- 
uring of the accumulated charge substantially the same 
for different pixels. In an integrating image sensor, a 

40 charge is also accumulated in the capacitor when the 
pixel is in darkness. This may distort the image signal 
from the pixel. To correct this, a so-called correlated 
double sampling (CDS) method has been developed, 
whereby the charge of the capacitor of the pixel is meas- 

45 ured after charge resetting preferably before exposure, 
and this value is stored for each pixel. The charge of the 
capacitor is measured again after the exposure time, 
and the stored value is subtracted from this measure- 
ment value. The difference corresponds better to the re- 

50 al image signal proportional to the quantity of light than 
an image signal obtained by one measurement. After 
the charge measurements presented above, the meas- 
urement value is subjected to analog/digital conversion, 
whereby the measurement result can be stored in digital 

55 form. 

[0007] In non-integrating CMOS image sensors, the 
current generated by each pixel is measured, which is 
proportional to the intensity of light to which the pixel is 
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exposed at the time. This kind of a sensor has the ad- 
vantage that each pixel can be designated separately 
and the current can be measured irrespective of other 
pixels and exposure times. This random access is eas- 
ier in integrating image sensors, if a mechanical shutter 5 
is used to set the same exposure time for different pix- 
els. 

[0008] CMOS image sensors can be also divided into 
passive and active image sensors. Their primary differ- 
ence lies in the fact that in active image sensors, the 
pixel is also provided with an intensifies This reduces 
the spreading of the charge of capacitors in the integrat- 
ing image sensor to the next capacitors at the stage of 
measuring the charge, which may distort the measuring 
results in passive image sensors. 
[0009] Irrespective of the type of the image sensor, 
the digitised values of the pixels are transferred for fur- 
ther processing typically in analog form, pixel by pixel. 
Thus, the image field is scanned for example line by line, 
starling from the first pixel on the first line. The analog 
image signal can be sent to be displayed e.g. by an an- 
alog display device. At the stage of further processing, 
the analog image signal can be converted to digital form 
e.g. for storage in an image memory, whereby the digital 
value formed from the analog signal of each pixel is 
stored in a memory location corresponding to the pixel 
in question The image signal can be subjected to e.g. 
filtering and noise suppression, if necessary. 
[0010] In currently known camera modules compris- 
ing an image sensor and control logic, the image infor- 
mation can be read either in analog form, whereby the 
signal must be subjected to analog/digital conversion for 
further processing steps, or readily converted in parallel 
digital form. Further the synchronisation of image infor- 
mation is conducted by the control logic of the camera 
module in a predetermined image format, whereby typ- 
ically a standard quantity of information must be trans- 
ferred from each image. The quantity of information for 
one image depends on the number of pixels in the image 
sensor, i.e. the resolution, and the accuracy of the ana- 
log/digital conversion of each pixel. For example, in an 
image sensor consisting of 480 horizontal lines and 640 
vertical lines, thereby comprising 307 200 pixels, each 
of which is subjected to analog/digital conversion of 8 
bits, the total information ol one image amounts to 2 457 
600 bits. 

[001 1] When such a camera module of prior art is con- 
nected to a portable electronic device, such as a mobile 
station, one problem is the greater space needed by the 
parallel bus solution, compared with using a serial bus 
for the transfer of image information. In a typical appli- 
cation, information of 8 bits per pixel is used in a black- 
and-white image and information of 24 bits per pixel in 
a colour image, whereby at least 8 parallel transfer lines 
are needed. When a separate camera module is used, 
the coupling cable to be connected with the parallel bus 
should comprise conductors for each line of the parallel 
bus and also a ground conductor and possibly a power 



supply conductor for the camera module, whereby the 
coupling conductor becomes considerably more expen- 
sive and stiffer to use than a coupling cable of a serial 
bus containing fewer conductors. Furthermore, possible 
capacitive coupling between signal transfer lines in the 
parallel bus may cause cross-talk between adjacent 
conductors. Cross-talk is easily increased when the 
length of the conductors is increased. Furthermore; par- 
allel data transmission complicates the structure of the 
device to be connected to the camera module and in- 
creases the manufacturing costs. 
[0012] The use of a serial bus in solutions of prior art 
would typically require increasing the data transfer rate 
at least 8 times compared with data transfer in parallel 
form, if the aim is to transfer the same quantity of infor- 
mation in the same time. This is not always possible, 
because fast digital signals have very sharp edges, i.e. 
the rise and fall times of the signal are very short, where- 
by they easily induce disturbances in the operation of 
the electronic device as well as other electronic devices. 
Also, signals containing rapid changes are susceptible 
to distortions which may affect the reliability of the data 
transfer. 

[0013] One disadvantage with present camera mod- 
ules is their inflexibility; they produce an image in a de- 
termined form at a rate determined by the camera mod- 
ule itself. Information produced by camera modules of 
prior art cannot be easily affected, whereby it may be 
necessary to conduct unnecessary functions in the de- 
vice receiving the image signal particularly when the 
quantity of image information entering the receiving de- 
vice exceeds the quantity that can be utilised in the re- 
ceiving device, whereby transferring the unutilised im- 
age information consumes power to an unnecessary de- 
gree. Some camera modules of this kind provide the op- 
tion of adjusting how often a new image is transferred 
from the camera module. However, the quantity of infor- 
mation in each image is not changed. If the receiving 
device cannot process all images at the set updating 
rate but controls the camera module to transfer images 
at a slower rate, the updating rate may sink to such a 
low level that it can be detected in the image e.g. as 
discontinuous movement. 

[0014] In several digital cameras, an LCD display de- 
vice is presently used for displaying image information. 
This display device is used both as a viewfinder for di- 
recting the camera to the desired photographic subject 
and for observing the picture taken, whereby the picture 
can be taken again, if necessary. Display devices of this 
kind are typically analog, whereby the image signal is in 
analog form. When used as a viewfinder, the image dis- 
played with a display device must be updated at a suf- 
ficient rate. The frequency of updating the image is lim- 
ited by the large quantity of image information to be 
transferred and the limited transfer rate. This results in 
discontinuous movement of the image to be displayed 
on the display device, particularly during movement of 
the camera or the photographic subject. Also in several 
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video cameras, an analog LCD display device is cur- 
rently used as a viewfinder, whereby the problems are 
similar during video recording. 

[0015] It is an aim of the present invention to provide 
an improved method for transferring image information 
e.g. to an electronic device, and a camera module from 
which image information can be transferred in serial 
form from an electronic device which may also control 
the transfer of the image. In addition, the image format 
can be modified according to the need. 
[001 6] According to a first aspect of the present inven- 
tion, there is provided a method for transferring image 
information from a camera module to an electronic de- 
vice, such as a mobile station, in which camera module 
an image is formed by an image sensor comprising pix- 
els where the light to which the pixels are exposed is 
converted into an analog signal which is converted into 
digital image information, characterised in that the im- 
age information is transferred in serial form and that the 
transfer of the image information is controlled from the 
electronic device. 

[0017] According to a second aspect of the present 
invention, there is provided a camera module compris- 
ing an image sensor with pixels for conducting photoe- 
lectric conversion, and means for conversion of the an- 
alog signal generated by said pixels into digital form, 
characterised in that the camera module further com- 
prises means for transferring digital image information 
toan electronic device, such as a mobile station, in serial 
form, and means for conducting the transfer of the im- 
age information under control by the electronic device. 
[0018] According to a third aspect of the present in- 
vention, there is provided a mobile station, character- 
ised in that it comprises: means for connecting a camera 
module, the camera module comprising an image sen- 
sor with pixels for conducting a photoelectric conver- 
sion, and means for converting the analog signal gen- 
erated by the photoelectric conversion means to digital 
form, and means for controlling the transfer of image in- 
formation formed by the camera module, and means for 
transferring the image information formed by the cam- 
era module to the mobile station in serial form. 
[0019] The invention is based on the idea that image 
information is transferred in serial form to an electronic 
device at a rate determined by the same. Furthermore, 
the quantity of image information to be transferred can 
be adjusted, whereby e.g. in viewfinder mode it is pos- 
sible to display images with less image information at a 
sufficient rate so that disturbing jerky movement is not 
shown in the image to be displayed on a display device. 
When taking the final picture, the quantity of image in- 
formation is raised to a desired level. 
[0020] The present invention gives significant advan- 
tages compared with prior art. In a camera implemented 
by the method of the invention, the viewfinder mode and 
video recording can be implemented so that the image 
follows the movements of the camera or the imaging ob- 
ject. In simple photography, the final photograph can be, 



nevertheless, taken with a resolution which is as high 
as that possible in cameras of prior art. In video record- 
ing, a sufficient image quality is obtained in normal sit- 
uations. Using the camera module of the present inven- 
5 tion, the size and power consumption of the electronic 
device can be made smaller than when using camera 
modules of prior art. Moreover, the solutions for trans- 
ferring image information according to the invention do 
not require increasing the signal transfer rate, whereby 
the number of disturbances can be kept significantly 
smaller than is possible when using solutions of prior 
art, the image transfer rate being the same. 
[0021] Furthermore, the present invention gives the 
advantage that the data transfer bus between the cam- 
era module and the electronic device can be made sim- 
pler and the connection means for connecting the cam- 
era module can be made simpler in the electronic de- 
vice. 

[0022] In the following., the invention will be described 
in more detail with reference to the appended drawings, 
in which 

Fig. 1a shows functional blocks of a camera module 
according to a preferred embodiment of the 
invention, 

shows the camera module according to a 
preferred embodiment of the invention in a 
reduced block chart, 

shows the connection of the camera module 
according to a preferred embodiment of the 
invention as a separate device to a mobile 
station, and 

shows the integration of the camera module 
according to a preferred embodiment of the 
invention in a mobile station. 

[0023] Figure 1 a shows functional blocks of a camera 
module according to a preferred embodiment in a re- 
duced manner. For the photoelectronic conversion of 
the image, the camera module 1 has an image sensor 
2 which in this example is a non-integrating CMOS im- 
age sensor, but the invention can also be applied in oth- 
er types of image sensor, such as integrating CMOS im- 
age sensors and CCD image sensors. The resolution of 
the image sensor 2 is for example 640 x 480, but the 
resolution as such has no significance in applying this 
invention. For clarity, not all pixels are shown in the 
drawings but as examples the first pixel P1 ,1 , the sec- 
ond pixel P2,1 and last pixel Pm,1 of the first line, the 
first pixel P1 ,2 of the second line, and the last pixel Pm, 
n of the last line are illustrated. A line selector 3 is used 
to select the pixel line to be examined at a time, and a 
column selector 4 is used to select the desired pixel 
P1.1 — Pm.n of the line selected by the line selector 3, 
the current generated by the pixel being conducted to 
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the output 5 of the column selector 4. Thus, the output 
5 of the column selector contains the current generated 
by the selected pixel P1.1 — Pm.n which is proportional 
to the intensity of light to which said pixel P1,1 — Pm.n 
is exposed at the moment of reading. When using an s 
integrating image sensor or a CCD image sensor, the 
charge is proportional to the intensity of the light to which 
the pixel P1.1 — Pm.n is exposed and to the exposure 
time, whereby a means is also required to discharge 
each pixel P1 , 1 — Pm,n. As mentioned earlier in this de- io 
scription, it is not easy to implement addressing of single 
pixels Pi , 1 — Pnrvn in CCD image sensors and integrat- 
ing CMOS image sensors, but in other respects, the op- 
eration of the camera module 1 according to the inven- 
tion is essentially similar to that when using a non-inte- 
grating image sensor 2. 

[0024] The output 5 of the column selector is coupled 
to a sample and hold circuit 6. The output voltage of the 
sample and hold circuit 6 is set at the moment of sam- 
pling substantially the same as the input voltage of the 
sample and hold circuit 6. This output voltage is kept 
substantially constant until the next sampling instant or 
during the holding time of the sample and hold circuit 6. 
With this sample and hold circuit 6, it is possible to keep 
the measuring voltage supplied to the analog/digital 
converter 7 for the time required for analog/digital con- 
version, whereby the analog/digital conversion is as re- 
liable as possible. If necessary, the digital conversion 
result of the analog/digital converter 7 is sent to a pre- 
processing block 8 where the image information can be 
subjected to some conversion and/or filtering opera- 
tions, such as conversion of colour image format, con- 
version of image information for different display devic- 
es, and image undersampling. 

[0025] ff the image sensor 2 is intended for taking col- 
our images, each pixel PI ,1 — Pm,n can consist of three 
partial elements tor different colour components. Typi- 
cally, a so-called RGB image format (red, green, blue) is 
used, whereby each colour component can be subjected 
to a separate photoelectric conversion. This can take 
place for example by arranging a red filter in front of the 
pixel measuring the red colour component, preventing 
the pixel from being exposed to light at substantially oth- 
er than red wavelengths; in a corresponding manner, a 
green filter is arranged in front of the pixel measuring the 
green colour component, and a blue filter is arranged in 
front of the pixel measuring the blue colour component. 
In the final image, one dot consists of these three pixels. 
These pixels corresponding to different colour compo- 
nents can be placed side by side for example on the 
same line or in the form of an isosceles triangle. Thus, 
for determining one dot, it is necessary to examine the 
signal formed by three pixels. This can be done e.g. so 
that the analog/digital conversion is conducted in the 
camera module 1 for each colour component one after 
the other using the same sample and hold circuit 6 and 
analog/digital converter 7. In another alternative, sepa- 
rate sample and hold circuits and analog/digital convert- 



ers are arranged for each colour component. Thus, each 
colour component is further provided with a selector, 
preferably a column selector 4. 

[0026] Furthermore, colour image sensors have been 
developed in which the number of pixels is the same as 
in a monochrome image sensor. This is achieved e.g. in 
a way that every other pixel is a pixel measuring green 
light, every fourth one is a pixel measuring red light and 
every fourth one a pixel measuring blue light. This is 
based on the capacity of the human eye; the sensitivity 
to different colours is different. Information given by the 
green pixel can be used as luminance information almost 
directly. In the final image signal, for example a group of 
four pixels is used to form the image signal of one dot. 
These methods are disclosed in more detail e.g. in pat- 
ents US-4,642,678 and US-4,630,307. 
[0027] The conversion of colour format e.g. from the 
RGB colour format to a so-called YCbCr format can be 
conducted by calculation as follows: 

(1a) Y = 0.299 R + 0.587 G + 0.114 B 
(1b) Cb = — 0.168R — 0.331 G +0.5 B 

(1c) Cr = 0.5 R — 0.4187 G —0.0813 B 

[0028] The luminance component Y indicates the 
grey tones of the image, and this can be used e.g.. in 
displaying a black-and-white image and in displaying a 
colour image as a black-and-white image. There are two 
chrominance components, Cb and Cr, which contain the 
colour information of the image. 

[0029] From the pre-processing block 8, the image in- 
formation is transferred to the memory 1 8 of the camera 
module. From the memory 18, the image information 
can be transferred to a parallel/series converter 9 where 
the digitised image information of each pixel P1 ,1 — Pm, 
n is converted to serial form. The image information can 
thus be read in serial form from a serial connection bus 
10. As the data transfer format in this serial bus, it is 
possible to use serial data transfer formats known as 
such, for example in a way that the image information 
of 8 bits is framed with initial and terminal bits. The trans- 
fer of the image information is advantageously control- 
led by the electronic device, as will be disclosed below 
in this description. 

[0030] For controlling the above-mentioned functional 
blocks, the camera module 1 is further provided with a 
control block 11 , which in this preferred embodiment in- 
cludes four control registers 12 to 15 and a timing block 
33. A sample register 12 determines at which moment 
the sample and hold circuit 6 takes a sample from the 
output 5 of the column selector. A quality register T3 de- 
termines the accuracy of the conversion to be conduct- 
ed by the analog/digital conversion. A pre-processing 
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register 14 determines whether an image format con- 
version is to be conducted in the pre-processing block 
8 and also whether image information in digital form is 
to be undersampled. The parallel/serial converted is 
further provided with a parallel/serial conversion register 

15 which controls data transfer on the serial bus 10. The 
control block also takes care of the operations needed 
for taking a picture, such as resetting the charges of the 
pixels P1 ,1 — Pm.n and timing the measurement of the 
charges of the pixels P1 ,1 — Pm.n. 

[0031] A control serial bus 16 is connected to the con- 
trol block 11 of the camera module e.g. for transferring 
control commands and parameters to the control block 
11. The control block 11 comprises further means (not 
shown) for controlling the line selector 3 and the column 
selector 4. 

[0032] Figure 1 b shows a camera module 1 according 
to an advantageous embodiment of the invention in a 
reduced block chart. In the camera module 1 of Fig. 1 b, 
e g the pre-processing block 8, the parallel/serial con- 
veitei 9 and the control block 11 of Fig. 1a are imple- 
mented in the digital signal processing unit 17 (DSP). In 
Fig. 1b, the image sensor 2 and the line selector 3 and 
column selector 4 are shown in one block 2\ In a corre- 
sponding manner the sample and hold circuit 6 and the 
analog/digital converter? are shown in one block 7'. The 
signal processing unit 17 is provided with a memory 16, 
preferably at least a random access memory RAM, e.g. 
for temporary data storage. Furthermore, the memory 
18 contains the control commands or the like required 
for controlling the operation of the digital signal process- 
ing unit 17. The memory 18 is coupled via a memory 
connection block 1 9 to the system bus 20 of the digital 
signal processing unit. The system bus 20 includes a 
data bus, an address bus and a control bus, but these 
are not shown separately, and the practical implemen- 
tation of these buses is prior art to someone skilled in 
the art. 

[0033] The digital signal processing unit 17 further 
comprises a serial connection circuit 21. It includes a 
parallel/serial conversion block for the information to be 
transmitted to the serial bus 1 0, as well as for converting 
serial form control information from the control serial bus 

16 into parallel form for transmission to the system bus 
20. 

[0034] The signal processing and control block 22 of 
the digital signal processing unit 17 controls the image 
sensor 2' for reading the image information of the pixels 
P1.1 — Pm,n. This is conducted advantageously so that 
in the selection lines of the line selector, which are 
shown as one line and indicated by the reference RSEL 
in Fig. 1a, the binary value is set to correspond to the 
desired line of the image; to select the first line, the value 
0; to select the second line, the value 1 , etc. Further- 
more, an output enabling line OE1 is conducted to the 
line selector, to change the state of the line selection line 
corresponding to the binary value set in the selection 
lines to another logical state, e.g. logical 0 state. Thus, 



10 

the logical 1 state corresponds to a situation where the 
line is not selected. In the logical 0 state, the first con- 
nection interface (conductor) of the pixels coupled to 
said line is set close toO V. In a corresponding manner, 

s in the selection lines SSEL of the column selector, the 
binary value is set to correspond to the column to be 
examined. As a result, the input line of the column se- 
lector, connected to the corresponding column lines of 
the image sensor, is coupled to the output line 5 of the 

10 column selector, whereby the signal of this line 5 corre- 
sponds to the signal of the selected pixel, which can be 
converted into digital form. 

[0035] Figure 2a shows the connection of a camera 
module 1 according to a preferred embodiment of the 

'5 invention as a separate module to an electronic device, 
preferably a mobile station 23, by means of an external 
connection bus 24. The external connection bus 24 
comprises a serial bus 10 and a control serial bus 16, 
whereby control information can be transferred from the 

20 mobile station 23 to the camera module 1 and image 
information can be transmitted from the camera module 
1 to the mobile station 23, respectively. The mobile sta- 
tion 23 is provided e.g. with a control unit 25 comprising 
advantageously a microprocessor CPU or a corre- 

2S sponding processor, a memory 26 and a serial connec- 
tion block 31 (serial input/output) for coupling the exte- 
rnal connection bus 24 to the mobile station 23. For ex- 
ample the serial/parallel conversions between the ex- 
ternal serial bus 24 and the system bus 24 of the mobile 

30 station take place in the serial connection block 31 . The 
memory 26 can be used e.g. for storing image informa- 
tion read from the camera module 1 , whereby the image 
can be displayed for example with a display device 27. 
One advantage of this separate camera module 1 is that 

35 the same camera module 1 can be used in connection 
with different electronic devices equipped with the re- 
quired connection means for connecting the external 
connection bus 24 with the electronic device. The exter- 
nal connection bus 24 can consist of conductors, or it 

40 can be implemented e.g. with infrared data transmission 
means. 

[0036] Figure 2b shows a solution in which the cam- 
era module 1 according to the invention is integrated in 
the mobile station 23. Thus, an internal serial connection 
45 bus 28 is arranged between the camera module 1 and 
the control block 25 of the mobile station, to transfer con- 
trol and image information between the camera module 
1 and the control block 25 of the mobile station. The in- 
ternal serial bus 28 is coupled to the serial connection 
50 block 31 of the mobile station which performs e.g. the 
serial/parallel conversions between the serial bus 28 
and the system bus 32 of the mobile station. Using this 
integrated solution, it is possible to achieve a relatively 
compact mobile station 23 also equipped with the cam- 
55 era function. This has the advantage that no separate 
external connection bus is needed between the camera 
module 1 and the control block 25 of the mobile station, 
and that the use of such an integrated device is in many 
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situations easier than the use of two separate devices. 
[0037] In the following, the operation of the method 
according to the invention will be described. It is as- 
sumed that the camera module 1 is intended for taking 
single photographs, corresponding to a normal digital s 
photographic camera, and that the image sensor 2 is a 
non-integrating CMOS image sensor. When preparing 
for taking a picture, the camera module 1 is set to view- 
finder mode, whereby image information of the camera 
module 1 is displayed on the display device 27, so that 10 
the user can direct the camera module 1 to the desired 
photographic subject and perform cut-out operations, if 
necessary. The optics of the camera module 1 can, in a 
manner known as such, comprise various objectives, 
exchangeable objectives and zoom objectives, but is 
these will not be discussed in more detail in this context. 
The user sets the camera module 1 to viewfinder mode 
preferably by using the keypad 29 of the mobile station 
23. The control block 25 of the mobile station interprets 
the button pressing and starts to set the function mode 20 
of the camera module 1 . To set the function mode, the 
control block 25 of the mobile station sends the required 
control commands and parameters to the control block 
11 of the camera module 1. These control commands 
contain the setting of registers according to predeter- 25 
mined parameters. For example, a command for taking 
a picture is set in the sampling register 1 2. In the quality 
register 1 3, the conversion accuracy is set for the ana- 
log/digital conversion of each sample, which may vary 
preferably from 1 to 8 bits in practical applications. In 
some cases, it may also be necessary to use a greater 
conversion accuracy. In viewfinder mode, the conver- 
sion accuracy is set smaller than in the actual photog- 
raphy mode, for example 4 bits instead of 8 bits. As a 
result, the analog/digital conversion converts the sam- 
ple at an accuracy of four most significant bits (MSB), 
whereby the conversion is also faster than when using 
a greater conversion accuracy. In a converter based on 
sequential approximation, reduction of the conversion 
accuracy to a half means doubling of the conversion 
rate. With four bits, it is possible to present 16 different 
values, but this is a sufficient accuracy in viewfinder 
mode. Furthermore, an increase in the conversion rate 
means that in the same time it is possible to transfer the 
image information of several pixels P1.1 — Pm.n, 
whereby, as a result, the image can be updated more 
often on the display device 27. 

[0038] Moreover, if desired, it is possible in the pre- 
processing register 14 to set information on whether the 
image information is to be subjected to a conversion, e.g. 
conversion of colour format. Furthermore, it is possible in 
the pre-processing register 14 to set information on un- 
dersampling, which means, for instance, that not all re- 
sults of analog/digital conversion are transferred further 
but for example every second one, or only the value of 
every other pixel is converted, which will also increase the 
updating rate of image information. Undersampling re- 
duces the resolution of the image, but, it is possible, if nec- 



essary, in the receiving device to form an image corre- 
sponding to the original resolution from the undersampled 
image, e.g. by interpolation on the basis of the received 
image information. 

[0039] Furthermore, information is transferred from 
the control block 25 of the mobile station to the control 
block 11 of the camera module about the moment for 
taking the picture. This command can be transmitted.by 
the mobile station 23 for example after the previous im- 
age has been processed. This applies particularly to 
non-integrating image sensors. The command for taking 
the picture can also be transmitted in advance, if taking 
the picture requires a longer exposure time, e.g. when 
an integrating sensor is used. Thus, after the transmis- 
sion of the command for taking the picture, the mobile 
station 23 has sufficient time for processing the image 
under processing, before the camera module 1 takes a 
new picture, and unnecessary waiting for processing of 
the image can be avoided. 

[0040] After the camera module has received the 
command for taking a picture, the control block 11 inter- 
prets the command and starts taking the picture. The 
control block 11 generates control signals for the line 
selector 3 and the column selector 4 to select the pixels 
P1,1 — Pm,n preferably in a way that one image is read 
as quickly as possible to eliminate e.g. movement dis- 
tortions in the image. The pixels are read for example 
in the following way. After receiving the necessary con- 
trol commands and parameters, the control block 11 of 
the camera module sets preferably the first pixel line-of 
the image sensor 2 for reading, with the line selector 3. 
Next, with the column selector 4, the control block 11 
selects the first column, whereby the current of this pixel 
is present at the output 5 of the column selector and is 
transferred to the sample and hold circuit 6. It may take 
a certain setting time to make the current value constant 
in the output 5 of the column selector before the control 
block 11 commands the sample and hold circuit 6 to 
sample this current. The setting time is advantageously 
some tens of nanoseconds. After the sample and hold 
circuit 6 has taken the sample, the control block 11 com- 
mands the analog/digital converter to start an analog/ 
digital conversion at a precision determined in the qual- 
ity register 13. The analog/digital converter 7 typically 
comprises a status line or the like, by means of which 
the control block 11 can monitor the completion of the 
analog/digital conversbn. After completion of the ana- 
log/digital conversion, the control block 11 transfers the 
conversion result to the pre-processing block 8 and per- 
forms pre-processing, if necessary. After this, the image 
information of the pixel is stored in the memory 1 8 of the 
camera module 1 , in a memory space allotted to the se- 
lected pixel. Next, the control block 1 1 sets in the column 
selector 4 information whereby the column selector4 se- 
lects the current of the next pixel into the output 5. This 
current value is subjected to the same operations as 
presented above. After conversion of the pixels in the 
whole line, the control block 11 selects the next line to 
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be converted, with the line selector 3. After the whole 
image field has been scanned, the image information is 
stored in the memory 18 and ready to be transferred. 
This transfer can be implemented e.g. in a way that the 
camera module 1 transmits information about the com- 
pletion of the conversion result of the image to the serial 
bus 10, whereby the control block 25 of the mobile sta- 
tion transmits a command to start image transfer to the 
control serial bus 16, if the mobile station 23 is ready to 
receive the image information. After this, the control 
block 11 transfers the conversion result of the first pixel 
from the memory 18 to the parallel/serial converter 9, 
where the conversion result is converted into serial form 
and transferred to the serial bus 10. II necessary, it is 
also possible at this stage to reduce the quantity of in- 
formation to be transmitted by leaving some of the less 
significant bits untransferred. The control block 25 of the 
mobile station receives this information and conducts 
serial/parallel conversion on the same, and transfers the 
information to the memory 26 of the mobile station, to a 
memory location reserved for the selected pixel. Next 
the information on the second pixel is transferred, and 
so forth, until the whole image has been transferred. 
[0041 ] Next, the control block 25 of the mobile station 
for example displays the image on a display device 27 
by transferring the image information from the memory 
26 to the display device 27, where the image information 
is displayed at a location reserved for it. If the display 
device 27 is an analog display device, the image infor- 
mation is further subjected to digital/analog conversion 
before transferring to the display device 27. 
[0042] When necessary it is possible to crop a small- 
er area (window) from the image to be transferred to the 
mobile station 23. This is conducted preferably by send- 
ing the co-ordinates of two opposite edge points (line 
and column identifications) of the area to be transferred, 
together with information on the desired conversion ac- 
curacy and resolution of the image. Also in this situation, - 
the camera module takes preferably a full picture and 
stores it in the memory, but only the image information 
on the desired area is transmitted to the serial bus 1 0. 
[0043] Furthermore, the invention can be applied in a 
way that the camera module 1 always takes a picture 
with the maximum resolution and conversion accuracy 
and stores the image in the memory 18. Thus, the res- 
olution and/or conversion accuracy is reduced at the 
stage of transferring information to the serial bus 10. 
[0044] In viewfinder mode, the quantity of image in- 
formation per image to be transferred is smaller than in 
normal photographic mode; consequently, images can 
be updated at a faster rate than when using solutions of 
prior art. Thus, the image is updated faster, and jerky 
movement cannot be noticed to a significant degree. 
Nevertheless, the final photograph can be taken with a 
higher resolution, whereby the control block of the mo- 
bile station transmits the required control commands 
and parameters to the control block 11 of the camera 
module 1 . Taking a picture in this way can be implement- 



ed for example so that the user presses a predetermined 
button in the keypad 29 of the mobile station. Thus, the 
camera module 1 conducts conversion of the image at 
a higher resolution, and after completion of the conver- 
s sion, the camera module 1 transmits the serial bus 10 
information about the completion of the image, whereby 
the control block 25 of the mobile station can start the 
transfer of the image information. In this case, the trans- 
fer of the image information takes a longer time than in 
to the viewfinder mode, but, on the other hand, it is not 
significant. 

[0045] The camera module 1 of the invention has the 
further advantage that image information can be trans- 
ferred asynchronously in relation to the functions of the 
camera. Thus, the camera module 1 of the invention can 
be controlled in a way that it generates an image of the 
desired type, whereby it is possible, if necessary, to re- 
duce the quantity of image information to be transferred. 
In camera modules of prior art, the image format and 
resolution can be changed, but the transfer of image in- 
formation takes place at a constant rate determined by 
the camera module, whereby typically either a parallel 
bus or a fast serial bus is needed for transferring the 
information at a sufficient rate from the camera module 
to further processing stages. 

[0046] Moreover, the camera module 1 of the inven- 
tion can also be utilised in video recording, whereby 
each single image consists of a smaller quantity of im- 
age information than in camera modules of prior art, but 
the updating rate of the images can be raised, whereby 
a more realistic moving image is obtained. Also, pictures 
taken with the camera module 1 of the invention can be 
transmitted via a mobile communication network, if nec- 
essary. Thus, with reference to the block diagram of Fig. 
2a/2b, the control block 25 of the mobile station reads 
the images in ways presented above and transfers the 
image information further to a radio element 30, from 
which the image information can be transmitted via a 
mobile communication network (not shown) to another 
mobile station or telecommunication terminal. Thus, the 
image information can be presented in the receiving tel- 
ecommunication terminal. If necessary, the control 
block 25 of the mobile station compresses the image to 
be transferred to the radio element, whereby the data 
transmission can be enhanced in the mobile communi- 
cation network. Because the processing of the image 
takes place primarily already in the camera module 1, 
the control block 25 of the mobile station does not need 
to have such a large processing capacity as when cam- 
era modules of prior art are used. 

[0047] The present invention includes any novel fea- 
ture or combination of features disclosed herein either 
explicitly or any generalisation thereof irrespective of 
whether or not it relates to the claimed invention or mit- 
igates any or all of the problems addressed. 
[0048] In view of the foregoing description it will be 
evident to a person skilled in the art that various modi- 
fications may be made within the scope of the invention. 
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Claims 

1 . A method for transferring image information from a 
camera module (1 ) to an electronic device, such as 
a mobile station (23), in which camera module (1) 
an image is formed by an image sensor (2) com- 
prising pixels where the light to which the pixels 
(P1 , 1 — Pm,n) are exposed is converted into an an- 
alog signal which is converted into digital image in- 
formation, characterised in that the image informa- 
tion is transferred in serial form and that the transfer 
of the image information is controlled from the elec- 
tronic device (23). 

2. The method according to claim 1 , wherein the quan- 
tity of the image information to be transferred from 
the camera module (1 ) can be adjusted. 

3. The method according to claim 2, wherein the ad- 
justment of the quantity of image information to be 
transferred from the camera module (1 ) is conduct- 
ed by adjusting the conversion accuracy of the an- 
alog/digital conversion. 

4. The method according to claim 2 or 3, wherein the 
adjustment of the quantity of image information to 
be transferred from the camera module (1 ) is con- 
ducted by adjusting the resolution of the image. 

5. The method according to claim 4, wherein the ad- 
justment of the resolution of the image is conducted 
by undersampling of the image information. 

6. The method according to claim 4 or 5, wherein in 
the electronic device (23), the resolution is restored 
by interpolation from the received image informa- 
tion. 

7. A camera module (1) comprising an image sensor 
(2) with pixels (P1 ,1 — Pm,n) for conducting photo- 
electric conversion, and means (6, 7) for conversion 
of the analog signal generated by said pixels into 
digital form, characterised in that the camera mod- 
ule (1 ) further comprises means (10) for transferring 
digital image information to an electronic device, 
such as a mobile station (23), in serial form, and 
means (1 1 , 16) for conducting the transfer of the im- 
age information under control by the electronic de- 
vice (23). 

8. The camera module (1 ) according to claim 7, where- 
in the camera module (1 ) further comprises means 
(11 ) for adjusting the quantity of image information 
to be transferred from the camera module (1 ). 

9. The camera module (1 ) according to claim 8, where- 
in said means (11 ) for adjusting the quantity of im- 
age information to be transferred from the camera 



module (1) comprise means (13) for adjusting the 
conversion accuracy of the analog/digital conver- 
sion. 

s 10. The camera module (1 ) according to claim 8 or 9, 
wherein said means (11) for adjusting the quantity 
of image information to be transferred from the cam- 
era module (1 ) comprise means (1 5, 33) for adjust- 
ing the resolution of the image. 

w 

11. The camera module (1) according to daim 10, 
wherein said means (33) for adjusting the resolution 
of the image comprise means (12, 13) for under- 
sampling of the image information. 

15 

12. The camera module (1) according to any of the 
claims 8 to 1 1 , wherein said means ( 1 1 ) for adjusting 
the quantity of image information to be transferred 
from the camera module (1) comprise means (15) 

20 for undersampling of the image information formed 
in the camera module (1). 

13. A mobile station (23), characterised in that the mo- 
bile station (23) comprises: ~* 

25 ... 

— means (10) for connecting a camera module 
(1), the camera module (1) comprising an im- 
age sensor (2) with pixels (P1.1 — Pm,n) for 
conducting a photoelectric conversion, and 

30 means (6, 7) for converting the analog signal 

generated by the photoelectric conversion 
means to digital form, and 

— means (24, 25) for controlling the transfer of 
image information formed by the camera mod- 

35 ule(l), and 

— means (24) for transferring the image infor- 
mation formed by the camera module (1 ) to the 
mobile station (23) in serial form. 

40 14. The mobile station (23) according to claim 13, 
wherein the mobile station (23) further comprises 
means (11) for adjusting the quantity of image infor- 
mation to be transferred from the camera module 
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(57) The invention relates to a method for transfer- 
ring image information from a camera module (1) to an 
electronic device, such as a mobile station (23). In the 
camera module (1), an image is formed by an image 
sensor (2) comprising pixels, where the light to which 
the pixel (P1.1 — Pm,n) is exposed is converted into an 
analog signal which is converted into digital image in- 
formation. The image information is transferred in serial 
form, and the transfer of the image information is con- 
trolled by the electronic device (23). 
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